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Abstract 

Our approach to higher order Fourier analysis is to study the ultra product of finite (or compact) 
Abelian groups on which a new algebraic theory appears. This theory has consequences on finite 
(or compact) groups usually in the form of approximative statements. The present paper is a contin- 
uation of 121 in which higher order characters and decompositions were introduced. We generalize 
the concept of the Pontrjagin dual group and introduce higher order versions of it. We study the 
algebraic structure of the higher order dual groups. We prove a simple formula for the Gowers uni- 
formity norms in terms of higher order decompositions. We present a simple spectral algorithm to 
produce higher order decompositions. We briefly study a multi linear version of Fourier analysis. 
Along these lines we obtain new inverse theorems for Gowers's norms. 
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1 Introduction 

Higher order Fourier analysis was started by Gowers 13, (3) generalizing Roth's Fourier analytic 
proof for Roth's theorem. In this framework Gowers introduced a sequence of norms ||/||t/ fc for 
functions on finite (or compact) Abelian groups. Let A be a compact Abelian group with the nor- 
malized Haar measure. For an L m measurable function / : A — ► C and teAwe introduce the 
function A t f whose value at x is f(x + t)f(x). By iterating this we also introduce A tl ^ 2 ,...,t k f- 
The norm ||/||;y fe is the 2 k -th root of the expected value of A tl .t 2 ,...,t k f(x) when t±,t2, ■ ■ ■ ,tk and 
x are chosen uniformly at random. 

Quite interestingly, it turns out that if / is bounded then the norm 1 1 / 1 1 u 2 decides if / is correlated 
with a harmonic function or / is just "random noise" (from the Fourier theoretic point of view). To 
be more precise, it is not hard to see that 

imk = (£M 4 ) 1/4 (i) 

where the numbers A^ are the Fourier coefficients of /. It follows that if ||/||2 < 1 then 

|Amax| < ||/||[7 2 < |A max 

for the maximal Fourier coefficient A max . 

It is possible that ||/||[/ 2 is arbitrarily small but ||/||f/ 3 is a fixed positive constant whereas for 
the "completely random noise" all the uniformity norms are very small. This suggest that functions 
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that are noise from the Fourier theoretic point of view can have structure measured by the higher 
uniformity norms. The natural question arises: 

What do the norms Uk measure in general? 

One can reasonably expect that either Uk measures something in Fourier analysis which is more 
complicated than the dominant coefficient or there is a generalization of Fourier analysis (a higher 
order version) that is relevant to the meaning of Uk- Even though the possibility of a pure Fourier 
theoretic approach can't be excluded, quite amazingly, it turns out that reality favors the existence 
of a higher order version of Fourier analysis. A work by Green and Tao [4 1 shows for example that 
if ||/||r/ 3 is separated from then / is correlated with a "quadratic structure". 

Another interesting fact is that the Higher order version of Fourier analysis, in a strict algebraic 
form, seems to appear only in the limit. We have to mention that a lot of work has been done in the 
finite case by Gowers, Green, Tao, and many others. Also limiting theories were studied by Tao, 
Ziegler, Host, Rra and others. 

In this sequence of papers we follow a different approach than previous papers. We build up a 
theory that is strongly related to hypergraph regularization. For this reason we use methods from 
the paper U in which the limits of hypergraph sequences are studied. Higher order Fourier analysis 
from our point of view is a theory that, in a precise algebraic form, appears on the ultra product 
of compact Abelian groups. Even though such groups are not compact (they satisfy a weakening 
of compactness), results in higher order Fourier analysis can be used to prove statements about 
measurable functions on compact Abelian groups. 

To keep things simple, most of this paper deals with the case when the groups (of which we take 
the ultra product) are finite, however the technique that we use is not limited to this case. As we will 
point out, most results can be extended to compact, (infinite) discrete, and some results to locally 
compact groups. 

An important feature of our theory is that while on a compact abelian group A linear characters 
span the whole Hilbert space L2 (A) it is no longer true on an ultra product group A. This creates 
space for an extended theory. Linear characters of A span a subspace in L 2 (A) which is the L 2 
of an A-invariant cr-algebra. We denote this cr-algebra by T\ and we call it the first Fourier a- 
algebra. Note that a finite analogy of an T\ measurable set is a set that is composed of a bounded 
number of Bohr neighborhoods. It turns out [6 1 that on A an interesting hierarchy of cr-algebras 
!Fq C J-\ C J-2 ■ ■ ■ appears (where Tq is the trivial cr-algebra). In general L2 is the orthogonal 
space of the space of functions with ||/||f/ fc+1 = 0. Note that Uk for the group A is a norm only on 
Loo(J-k-i) and is a semi-norm in general. 

The fundamental theorem in our theory (proved in 1 6 1) says that Li {Tk ) can be uniquely decom- 
posed into the orthogonal sum of the (^-closures of) rank one modules over the algebra L 00 (JT fc _ 1 ). 
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In particular L^iTx) is decomposed into rank one modules over L^iTo) = C which is ordinary 
Fourier theory. Our fundamental theorem immediately gives rise to a so-called fc-th order Fourier 
decomposition. For every fixed fc each bounded measurable function / on A can be uniquely de- 
composed as 

/ = g + h + h + h + ■ ■ ■ 

converging in Li such that ||5||f/ fc+1 = and /j are chosen from distinct rank one modules over 
L 00 (J r / £ _ 1 ). The components are the projections of / to the different rank one modules. 
Now we list the topics investigated in this paper: 

Additivity result for the Gowers norms: We show that the 2 k+1 -th power of the norm Uk+i is 
additive on the terms of the fc-th order decomposition of /. This generalizes the equation (Q]). 

Local behavior of higher order characters: We show that the fc-th order components /j have a 
"locally fc-th degree" structure relative to a separable cr-algebra contained in J^k-i ( see lemma l3~4l 
and corollarv l3.U . Intuitively it means that the fc-th order components /,; have a fc-th degree behavior 
on neighborhoods that have a degree k — 1 structure. Furthermore the whole group A is covered by 
these neighborhoods corresponding to /j. It is important to mention that here by a degree fc function 
we mean a function whose fc-th difference function is constant. 

Spectral approach: For every fc and / we construct an operator in a simple way whose eigenvectors 
are the fc-th order components /1 , f%, . . . of /. We call this fact the "spectral form of the fundamental 
theorem". (An interesting feature is that a fc-th order generalization of convolution seems to appear 
here.) This part of the paper gives some hope that a finite version of fc-th order decompositions 
could be efficiently computed. At the end of the paper we sketch a finite translation of this topic but 
details will be worked out in a separate paper. 

Limits of self adjoint operators: The spectral approach can be best translated to finite results if a 
limit theory for operators is available. We prove a theorem in this direction which has consequences 
of independent interest. For example it implies a spectral version of the strong regularity lemma. 
It also implies that for a convergent graph sequence the joint distributions of the (entries of the) 
eigenvectors corresponding to the largest eigenvalues converge. (Note that it is easy to see that the 
eigenvalues converge) Further details on this will be available in a separate paper 0. 

Higher order dual groups: Rank one modules over L^Tt-i) are forming an Abelian group that 
we call the fc-th order dual group and denote by A&. We study the algebraic structure of A& which 
turns out to be closely related to the dual of the fc-th tensor power of A. This also justifies the 
name "Higher order Fourier Analysis". To be more precise we show that every element in Aj. 
can be characterized by an element of hom(A, Ak-i/T) where T is a countable subgroup. Such 
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countable subgroups will be called "types" in general. Note that in some sense T encodes the dual 
concept of a k — 1 degree "neighborhood". In particular, if c/> is a "pure" k-th degree character, i.e. 
At 1 .t 2 ....,t k+1 4>( x ) is the constant 1 function, then the element of Afc representing <j> has the trivial 
group as T. This corresponds to the fact that in this case <f> is nice on the whole group. Countable 
subgroups T of the first dual group Ai define Bohr neighborhoods in our language. The intersection 
K of the kernels of the characters in T is a subgroup of A which is the ultra product version of a 
Bohr neighborhood. The factor group A/T has a compact topological group structure. 

The homomorphism sets hom(A, A^-x/T) as T runs trough all countable subgroups are form- 
ing a direct system. We denote the direct limit by hom*(A, Ajt_i). We prove that Afc is injectively 
embedded into horn* (A, Afe_i). This has numerous consequences on the structures of the dual 
groups. For example it shows that Afc is embedded into 

horn* (A, horn* (A, . . . , horn* (A, hom(A, C))) . . .) 

where the number of horn* 's is k — 1. This shows the connection to the fc-th tensor power of A. 

Multi linear Fourier analysis: In a short chapter, out of aesthetical reasons, we put down the foun- 
dations of "multi linear Fourier analysis" which seems to simplify Higher order Fourier analysis. 
The main point is that degree k functions (functions measurable in Tk) can be represented (with- 
out loosing too much information) in a tr-algebra whose elements are in some sense fc-linear. The 
representation is given by the simple formula 

V k {f){t 1 M,---M)= I A tl , t2 ,..., tfc /(.*). 

J X 

This brings Higher order Fourier analysis one step closer to usual (linear) Fourier analysis. A good 
example is that if is a pure fc-th order character then A tl ^ 2 ,...,t k f{x) doesn't depend on x and 
is fc-linear in ti, t%, . . . , tfc. Degree fc-pure characters in characteristic p can look difficult but the 
representing multi linear form takes only p-th root of unities. 

Finite translations and the inverse theorem: Last but not least we translate some of our results 
into finite statements to demonstrate how it works. In particular we get an inverse theorem for the 
uniformity norms (see Theorem[9]). Roughly speaking it says that if ||/||j/ fc is separated from then 
/ is correlated with a function /' that has a degree k — 1 structure structure. This means that the 
abelian group can be decomposed into a bounded number of sets that are level sets of functions with 
a degree fc — 2 structure such that the value of A tl .t 2 ....,t k f'(x) depends only (with a high probability 
and with a small error) on the partition sets containing the partial sums x + J2ies ^- Notice that the 
notion of a "function with a degree k structure" is recursively defined. As a starting step, functions 
with a zero degree structure are only the constant functions. This means that functions with a first 
degree structure are close to ordinary characters. It is important to note that the theorem is close to 
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the so called strong regularity lemma in spirit. For example the error in the definition of a degree k 
structure can be made arbitrary small in terms of the number of partition sets. 

Remarks: Some important topics are not discussed in this paper including connections to nilpotent 
groups, and the non-commutative theory. They will be discussed in a subsequent paper. A third part 
of this sequence is in preparation. 

1.1 Overview of the first paper 

We denote by A the ultra product of the sequence {vlj}?^ of growing finite Abelian groups. The 
set A is a probability space with the group invariant cr-algebra A and measure fi introduced in [6 1. 

Let denote the trivial cr-algebra on A. A measurable set S G A is called separable if the cr- 
algebra generated by all translates S + x is separable i.e. it can be generated by countable many sets. 
If B is a shift invariant cr-algebra in A and S G A then we say that S is relative separable over B if 
the sigma algebra generated by B and all translates S + x can be generated by B and countably many 
extra sets. Separable elements in A are forming a cr-algebra that we denote byTi. We construct a 
growing sequence of cr-algebras Ti recursively such that Ti is formed by all measurable sets which 
are relative separable over 

Let C denote the set {x\x G C, \x\ = 1}. For a function / : A — > C and J £ Awe introduce the 
notation 

A t f{x) = f{x + t)J{x)- 

Similarly we define A tli t 2 ,...,t k f(%) by iterating the previous operation. The 2-th root of the ex- 
pected value of A tl j 2 ,...,t k f(x) where x, t±, t%, . . . , tk are chosen uniformly at random is called the 
fc-th Gowers (semi)-norm of /. 
It was proved in [6| that 

Lemma 1.1 (Norm characterization) For a measurable function / G L OQ (A, n) we have that 

ll/lla^llEC/I^OH^. 

Furthermore the k-th Gowers (semi)-norm of f is if and only if f is orthogonal to Li{Th-\, A*)- 
In particular Uk is a norm on L 00 (J-fc_i). 

We denote the fc-th Gowers norm either by Uk{f) or by ||/||j/ fc . 
The fundamental theorem proved in [6] says that 

Theorem 1 (Fundamental theorem) L^ifFki^) is equal to the orthogonal sum of all the (L^- 
closures of) shift invariant rank one modules over the algebra (!Fk-i, m)- Every ( shift invariant) 
rank one module over L^Tk-i, p) has a generating element <p : A — > C such that the functions 
A t (j) are measurable in Tk-ifor every t G A. Such functions are called k-th order characters. 
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It is clear that fc-th order characters are unique up to multiplication with elements from {Fk- 1 , m) 
of absolute value 1. 

Every function / 6 L 2 {A 1 [i) has a unique (possibly infinite) decomposition 

/ = /o + h + h + ■ ■ ■ 

where f is orthogonal to and for i > the functions are contained in distinct rank 1 modules 
over Loo (Tfe-x,^). 

1.2 Compact groups, discrete groups and other generalizations 

In our paper usually A is the ultra product of a sequence {Aj}?^ of finite abelian groups. However 
finiteness is not significant here. One can replace A^ by compact groups with the normalized Haar 
measure on them. In this case the er-algebra on the ultra product is generated by ultra products of 
Borel sets and the measure is the ultra limit of the Haar measures. 

More interestingly one can extend the theory to the case where Ai are discrete infinite Abelian 
groups with finitely additive measures Ti with total measure one. Since Abelian groups are amenable, 
such measures always exist. In this case, quite interestingly, the ultra product becomes an ordinary 
measure space. Again the a-algebra is generated by ultra products of subsets of A^. 

Some of our theory can be generalized to locally compact groups, but one has to be much more 
careful in that case. We will discuss that in a separate paper. 

Finally, an interesting direction is the case when the groups Ai are not commutative. In this 
situation a "higher order representation theory can be studied" This is also a topic of a forthcoming 
paper. 

2 Basics 

2.1 Shift invariant a-algebras and i3-orthogonality 

Lemma 2.1 Let Bbea shift invariant a-algebra in A If(f) : A — ► C satisfy that A t <j) is in (£>, fi) 
for almost every t then it is true for every t. 

Proof. Let t be arbitrary and t 2 be chosen randomly. Then with probability one both (f>(x + 
t)<fi(x + t 2 ) and <j)(x + t2)4>{x) are measurable in B with probability one. Taking such a t 2 and 
the product of the two expressions the proof is complete. 

Lemma 2.2 Let B be a shift invariant a-algebra. Let <j> : A — > C be a function such that A t </> is 
measurable in B for every (6 A. Then either E(</>|B) is constant or (j) G B. 
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Proof. Let <fr* = E(0|B). Then for every t we have that 



4>*{x + t)= E{cf>{x + t)\B) = E(<j)(x)(<f>{x + t)cj)(x))\B) = (/>*(x)<f>{x + t)<f>{x) 

for almost all x. Assume that cj)* is not on a positive measure set. We obtain that there is a fixed x 
with 4>* (x) ^ such that 

cj)*(x + t) = 4>*{x)(j>{x + t)(j){x) 

for almost all t. Since \<fi(x)\ — 1, this implies that cf)(x + t) is measurable in B and its shifted 
version <fi(t) is also measurable in B. 

Lemma 2.3 Let B C A be a shift invariant a-algebra and <fi : A — > C be a function such that 
A t (f> € B for every £ € A. Then (j) is contained in a shift invariant separable extension ofB. 

Proof. Since the level sets of cj) can be generated countable many sets it is enough to prove that 
the cr-algebra B' generated by <f> and B is again shift invariant. The formula <f>(x + t) = <fi(x)/A t (j) 
implies that for every fixed t the function x i— > <j>(x + 1) is measurable in B' . It follows that any shift 
of £>' is contained in B'. Since shifts have inverses the proof is complete. 

Definition 2.1 Let B C A be a a-algebra. Two measurable functions /, g on A are called B- 
orthogonal if¥,(fg\B) is the constant function. 

Lemma 2.4 Let /, g be elements from two distinct rank one module over L 00 (^ r fc_i). Then f and 
g are F^—l orthogonal. 

Proof. We can assume that / and g are k-th order characters. It is clear that h = fg is a k-th order 
character and that it is not measurable in Tk-i- Now lemma l272l completes the proof. 
The next lemma is an immediate consequence of lemmaQTT] 

Lemma 2.5 Two functions /, g are J~k-i orthogonal if and only if \\f~g\\u k = 0. 

2.2 The fundamental theorem 

In this section we elaborate on the fundamental theorem. We restate it in a more detailed form. 

Theorem 2 (Variant of the Fundamental theorem) Fix a natural number k. 

1. Every function f £ LoofA,^!) can be uniquely decomposed into two parts f = /' + g 
where ||/'||!7 fe+ i = ll/l|j/ fc+ i an d \[9\\u h+1 = such that /' is orthogonal to any function h 
with \\h\\u k+1 = (or equivalently /' is measurable in Tu). The function /' is equal to the 
projection E(/|^-fc). 
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2. The function f can be uniquely decomposed into the L% sum of functions with 
II/'IIp > ||/i]]p for all i G N, 1 < p < oo such that \\fij]\\u k = for i ^ j and A t fi 
is orthogonal to any function h with \\h\\ij k — (or equivalently A t fi G Tk-i). 

3. For every fi there is a k-th order character 4>i : A — > C and function gi measurable in Th-\ 
such that fi — (pigi. In particular \ fi\ = gi G J'k-i- 

Proof. Most of the parts are trivially equivalent with the original form. We prove the inequality 
II/'IIp > WfiWp f° r P ^ !■ Let be a character representing the module of fi. Then by lemma |2~4l 
we have that fi = E(f$\J r k-i)4>- 11 follows that 

||/i||p = ||E(/ / ?m_ 1 )|| p <||/^|| p = II/'IIp. 

The equality ||/j/j \\u k = in part two also follows from lemma [2~4l 

2.3 Higher order decomposition as spectral decomposition 

Let Dj. denote the subspace of all functions / in L 2 (A x A, T k x T^) with the property that the 
functions x ^> f(x, x + t) is in Tk-i for (almost) all t G A. 

Definition 2.2 Let k be a fixed natural number. We define the operator 

K k : Loo (A, .A) — > Loo (A x A, J* x 

smc/z f/zaf ICk(f) is the orthogonal projection ofh(x, y) := f(x)f(y) to D k 

From this definition it is not even clear that JCk (/) is in L^. This follows from the next lemma. 

Lemma 2.6 Let k be a natural number and f G L oc (A, .A). Let 

g(x,t) :=E x ((A t /)(a;)|^_ 1 ) 

then 

fck{f)(x,y) = g(y,x- y). 

The above lemma follows from the results in j6). Let us assume that / = /' + .? where /' = 
E(/|JT fc ). Then we have the following. 

Lemma 2.7 For almost every t we have that 

E x ((A t f)(x)\T k ^) = E x ((A t f')(x)\T k ^). 

Proof. Let Wk denote the orthogonal space of L^iJFk). It is clear that W k is a shift invariant 
Looi^k) module. We have that 

(A t f)(x) = (A t f')(x) + (A t g)(x) + f(x + t)gjx) + g(x + t)J{x) 
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where the last two terms are in W k - This implies that 

E a ((A t /)(a:)|.F fc _ 1 ) = E x ((A t f)(x)\T k ^) +E((A t g)(x)\T k ^). (2) 

It remains to prove that the second term in (O is for almost every t. In other words we have to 
prove that || Atg\\u k = hold almost always. This follows from the next equation. 




An important corollary is the following. 
Corollary 2.1 For an arbitrary f € L oc (A, A) the equation K, k (f) — fck(E(f\T k )) holds. 

Two variable measurable functions in general can be interpreted as integral kernel operators. It 
will be fruitful to see Kk as an operator valued operator. It is obvious from the definition that Kk (/) 
is a self adjoint operator. Due to the fact that lCk{f) is measurable in T k x T k , for every / there 
is a separable sub er-algebra B C T k such that IC k (f) is measurable in B x B. This means that we 
can apply the theory of integral kernel operators on standard Lebesgue spaces. We say that IC k (f) is 
simple if all its non zero eigenvalues have multiplicity one. For the sake of simplicity we introduce 
the convention that elements in £2 (A) can be looked at "column vectors". With this convention, if 
/, g G L2 (A) then fg* denotes a two variable function defined by fg*(x, y) — f(x)g(x). 

The next crucial theorem shows that the fc-th order Fourier decomposition of / is "basically" the 
same as the spectral decomposition of lCk(f) 

Theorem 3 (Spectral form of the fundamental theorem) The terms {/i}^ in the k-th order Fourier 
decomposition of f satisfy 

00 

i=l 

converging in L^. 

Corollary 2.2 The terms {/i}^ in the k-th order Fourier decomposition of f are all eigenvec- 
tors of the operator ICk(f)- The eigenvalue corresponding to fi is ||/i||2- Furthermore the system 
{fi}°Zi L2-spans the image space ofJCk(f). In particular if)Ck(f) is simple then its eigenvectors 
are exactly the scalar multiples of the functions f. 

Proof. Thanks to corollary 12. l| we can assume that / £ T k and / = £\ f% is the fc-th order Fourier 
decomposition. First of all notice that the two variable functions fif* are pairwise orthogonal in 
L 2 (A x A). It is also clear that ||/i/*||2 = H/ilhll/jlh- Now we have that 

EiiA/;ii2 = (En^ii2) 2 = ii/ii2<^ 
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which implies (together with orthogonality) that Y^ij fifj converges in L2 to //*. Let us write 
//* = q + h where q = J2 i fif* and h — J2 t ■ fifj - The function q is an element of the space 
Dk since the functions f. L satisfy Aj/j £ for every t. We claim that h is orthogonal to Dk- It 

is enough to prove that for every pair i 7^ j of natural numbers is orthogonal to Dk- Let g be 
an arbitrary function in Dk- Then 

(fifj, 9)= fi{x)fj(y)g(x,y) = / fi(x)fj(x + t)g(x, x + 1). 

Since fi(x)fj{x + 1) is orthogonal to L 2 {J-k-i) for every fixed £ (see lemma |2~4b the proof is 
complete. 

The natural question arises how to identify the fc-th order decomposition of / if ICk (/) is not 
simple. The following observation helps. 

Lemma 2.8 Assume that F — /2, . . .} is the set of k-th degree Fourier components of a 
function f. Let A 7^ § be an eigenvalue of ICk(f), V\ be the corresponding eigen-subspace 
and let F\ = {h\h 6 F, = A}. Then F\ is an orthogonal basis of V\. Furthermore if 

i) = J2heF x a hh 6 V\ and w = z + J2 heFx Phh where (z, V\) = then 

Kk{v)w = ^2 \oih\ 2 Whh. 

h£F x 

In particular the (non zero) eigenvalues of K,k(v) are{\cth\ 2 \ \h G F\} and the set A\ = {lCk(v)\v S 
V\} is a commutative algebra of dimension d = dim(V^) over K. 

Proof. This lemma follows from theorem [3] by using the fact that the /c-th order components of v 
are exactly {a h h\h e Fx} and so JC k (v) = Y^heF x Wh\ 2 hh*. 

Corollary 2.3 If v S V\ is such that the eigenvalues ofKk(v) are all distinct then the one dimen- 
sional eigen-subspaces are generated by the elements from F\. 

Now assume that we are given the subspace V\ and we want to determine the set F\. First of 
all note that if h' is a scalar multiple of an element h £ Fx then h = h'(h', f)/\\h'\\2- The previous 
corollary shows that, to find the elements of Fa up to scalar multiples, it is enough to find a vector 
v £ Vx with distinct eigenvalues. We also know by lemma 12751 that almost all vectors in Vx have 
this property. It will be useful to give a "finite" algorithm to find such a vector v. The next lemma 
says that there is finite set of vectors that can be used for this purpose. 

Lemma 2.9 For every n there a finite subset T n of the n-dimensional euclidean space E n over C 
such that for every orthonormal basis b\ , b% , . . . , b n of E n there is a vector v £ T n with \ \(v,bi) \ — 
\(v,bj)\\ > 1 whenever i =/= j. 
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Proof. If we don't require the finiteness of T n then the compact set 

U = {v\\\v\\l<4n 3 } 

is clearly good since v = Yl7=i 2€6< is a good choice. The compactness of T' n implies that for every 
e > there is a finite subset S e in T' n such that every vector in T' n is of distance at most e form this 
set. It is clear that if e is small enough then S t is a good choice for T n . 

Now we summarize our knowledge: 

An algorithm to compute the fc-th order Fourier decomposition: 

Let Ai > A2 > A3 . . . be the list of distinct eigenvalues of JCk{f)- Let Vi, V2, V3, . . . be the 
list of corresponding eigenspaces with dim(t^) = d;. For each space Vi we choose a separating set 
Td t guaranteed by lemma 1X91 Then we pick an element vi € Td, such that K.k(i>i) has ck distinct 
eigenvalues. We denote the set of eigenspaces of lCk(vi) by Qi. We have that Q = UiQi is the 
collection of one dimensional subspaces generated by the k-th order Fourier components of /. Let 
{w q } q( zQ be a system of functions with w q S q , ||w g || 2 = 1. Then the set {/„ = w q (w q , f)\q € Q} 
is the set of k-th order Fourier components of /. 

2.4 Limits of self adjoint operators 

Let Mi : x X, — ► C be a sequence of self adjoint matrices with || Mi || 00 < 1 and = m. L . 
As always in this paper, we think of A", as a finite probability space with the uniform distribution 
and L 2 (AQ ) as L 2 of this probability space. This defines the proper normalization of scalar products 
and action on L2(AQ). In particular we think of Mj as an integral kernel operator on LgpQ)- ^his 
means that if / : X, ; — > C is a function then then the product Mif is defined by. 

M l f{x)=mT 1 M i (x,y)f(y). 

Traces and products of matrices are normalized accordingly. 

Assume that the eigenvalues (with multiplicities) of Mi are Aj,i, Aj,2, ■ ■ ■ ordered in a way that 
I Aj,i I > |A,,2 !>•••. Let fij be an eigenvector corresponding to Ajj such that for every fixed i the 
system {fi,j}J!z 1 is an orthonormal basis. We have that 

mi 
i=l 

Theorem 4 Let M denote the ultra limit of{Mi}j2-i, fj denote the ultra limit of {fij}^ 1 and Xj 
denote the ultra limit of {Xij}°° =1 . Then 

00 

E(M\a 1 xa 2 )= ^ /,/;A, (3) 

t?'|A 3 ->0} 
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converging in L 2 , where o\ and o 2 are the two cylindric o-algebras on X x X depending on the 
first and second coordinates. 

Proof. We start with a few observations. First of all note that |/i,j||oo < This implies that 

if A j > then the ultra limit of fj exists and it is an measurable function with \\fj \\ ^ < l/Xj. 
Second observation is that YlJLi \^j\ 2 — T This follows from the fact that for every i we have 
\^j\ 2 = Tr (MjM*) < 1. In particular we get the L 2 convergence of the sum in the theorem. 
Third observation is that for every — 1 valued function h we have that 

t 

\hM i h*-Y,h*fi, j fl j hX i , j \ < y/l/t. 
i=i 

To see this we rewrite the left hand side as 

E h *kifi,j hX hj\- 

The term h* fijf.*jh is equal to \(h, fi.j)\ 2 - Since {fij\t < j < mj is an orthonormal system we 
have 

£ K^/m)I 2 < \\h\\i<i- 
j=t+i 

The second observation implies that |A;.j| < y/TJi for all j > t. This completes the proof of the 
third observation. 

Now we are ready to finish the proof. Let M' be the left hand side of (f3]). The third observation 
implies that if h is an ultra limit of — 1 valued functions than h*Mh — h*M'h. It is easy to 
see that this implies that for two different measurable — 1 valued functions hi and h 2 we have 
h\Mh,2 — h*M'fi2- In other words the integral of M on product sets is the same as the integral of 
M'. Since every measurable set in a\ x 02 can be approximated by disjoint unions of product sets 
and M' is obviously measurable in u\ x 02 the proof is complete. 

The above theorem has interesting consequences. 

Theorem 5 (Spectral form of the regularity lemma) For every function F : N — > K + and every 
e > there is a constant n such that for every self adjoint matrix M : V X V — > C with \\ M\\ oo < 1 
and \V\ > n there is a number no < n such that the spectral approximation Y^i=i fifi^i °f M is 
at most e close in L 2 to a matrix M' which is F(no) close in the normalized cut norm to M. 

Another consequence (roughly speaking) says that if Gi is a convergent graph sequence with 
limit W then for every fixed k the joint distribution of the values in the first k eigenvectors (corre- 
sponding to the k biggest eigenvalues) converges in distribution to the joint distribution of the first k 
eigenvectors of W (as an integral kernel operator). Note that there is a small problem with multiple 
eigenvalues which can be handled by careful formulation. These results and many others are proved 
in the paper Q . 
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2.5 Measurable Homomorphisms 

Let hi : Ai — > i?; be a sequence of surjective homomorphisms between the finite Abelian groups 
Ai and B. L . Let B denote the ultra product of the sequence {Bi]°^ 1 and B the ultra product er- 
algebra on it. We can take the ultra product h of the functions hi which creates a surjective measure 
preserving homomorphism from A to B. We will need a few lemmas. The next one is obvious. 

Lemma 2.10 If f is a function in L 00 (y8) and k is a natural number then 

U k (J) = U h {haf) 

where the first Gowers norm is computed on B and the second is computed on A. 
Lemma 2.11 Iff e L^A) satisfies U k (f) = then C/ fe (E(/|h- 1 (B))) = 0. 

Proof. First of all note that h _1 (,B) is a coset er-algebra on A so it is perpendicular to every shift 
invariant cr-algebra. Now Uk{f) — implies that E(/|JT fe ) is the function. This implies that 

E(E(f\T k )\h- 1 (B)) = 0. 

Using perpendicularity we can interchange the projections and obtain 

E(E(/|h- 1 (^))|^ fe ) = 0. 

This completes the proof. 

As a consequence we get the following. 

Lemma 2.12 h" 1 ^^)) = f t (A) nh^fg). 

Proof. Let / € L OQ (h^ 1 (B)). We know that / 6 T k if and only if / is orthogonal to any function 
g with Uk(g) — 0. However the scalar product (f,g) is equal to (/, E(g|h _1 (£>))). By Lemma 
12.1 II this implies that / 6 T k if and only if / is orthogonal to every g with U k (g) = such that 
g is measurable in h _1 (S). This is equivalent with saying that / has the form ho/' where /' is 
measurable in JT fc (B). 

2.6 Lemmas on a-algebars 

In this section (X, A, fi) will be a probability space with er-algebra A and measure /i. All the 
er-algebras occurring in this chapter will be assumed to be subalgebras of A. 

For two CT-algebras B and C in A we denote by B V C the smallest cr-algebra containing them 
and by B A C the intersection of them. 

Definition 2.3 We say that B and C are perpendicular if for any B measurable function f the 
function E(/|C) is again B measurable. 
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We will use the following lemma. 

Lemma 2.13 Let B and C be two perpendicular a-algebras and let B\ be a sub a-algebra of B. 
Then (C V Si) A B = (C A B) V B x . 

Proof. Both terms of the right hand side are contained in both terms of the left hand side so we 
have that (C V Bi) A B D (C AS) V B\. To see the other containment let H be a set in (C V Si) A S. 
Using that H G C V Si we have that for an arbitrary small e > there is an approximation of the 
characteristic function 1# in Li of the form 

n 
i=l 

where Cj € C and Bi 6 Si. Since — f\\-2 < e and H e S we have that 

n 

e > ||E(l ff |B) -E(/|B)|| 2 = HI* - ^E(1 C ,|S)1 B J 2 . 

i=i 

Using perpendicularity we have that £'(lc i |S) is measurable in S A C for every i and the whole sum 
is measurable in (C A S) V Si. Using it for every e the proof is complete. 

2.7 Cubic structure 

Let d be a fixed natural number. For every subset S C {1, 2, . . . , d} we introduce a homomorphism 
V>s : A d+1 — * A defined by 

These functions are measurable in the ultra product measure. Let us denote by Bs the u-algebra 
1 (^l). The next crucial fact was proved in 0. 

Lemma 2.14 

B H /\( V Bs)=i>H l {?d-i) 

S^HC[d] 

when H is any fixed subset of[d]. 

The reader should also notice that the cr-algebras Bs behave in a very symmetric way. There is a 
group of measurable automorphisms that permute these cr-algebras transitively. In fact this group is 
the same as the automorphism group of the rf-dimensional cube. The details are given in |6|. Note 
that the cr-algebras Bs are so called coset cr-algebras (see J6l) and so they are perpendicular to any 
shift invariant cr-algebra. An important corollary of Lemma l2.14l is the following. 

Corollary 2.4 Let {fs}sc[d\ be a collection of L oc (A, A) functions. Assume furthermore that 
there exists a subset H C [d] such that E(/# | J-d-i) is the zero function. Then 



15 



Jx,ti,ta,...,t d S g [d] igS Jx,ti,t 2 ,...,t d s< -^ 

Proof. Let £> denote the shift invariant a-algebra 

V B B . 

S=£HC[d] 

We have that the integral can be rewritten in the form 



(4) 



E(f H oyj H \B) U (5) 



x,ti,t 2 ,...,U H^SC[d] 

because the product II.ff^sc[d] fs ° i^S is measurable in B. 

Using lemma |2T4l and that ij)^{A) is perpendicular to B we obtain that 

E(f H oi> H \B)=E(f H oTj; H \BnB H ) = 
= E(/ H o VhIV-h 1 (Fd-i)) = EtfHlFd-l) ° ^ H = 0. 

This implies that (0 is zero. 
We now prove a useful lemma. 

Lemma 2.15 (Mixed term lemma) Let {fs}sc[d+i] be a system of functions on A. Suppose 
that there is a collection of shift invariant subsets Tii, H2, ■ ■ ■ , H n in of A. such that for every 
pair 1 < i < j < n and functions gi £ TLi, 52 £ 1~tj we have E(gig2\J 7 d—i) = 0. Assume 
furthermore that fs is contained in one of these sets for every S. Then 

E x , tut2 ,..., td+1 n (/5°^) c(|si) =o 

SC[d+l] 

whenever the functions fs are not all contained in the same set. (The operation c{\S\) is the complex 
conjugation applied \ S\-times.) 

Proof. If the functions fs are not all contained in the same set then there is an element r G [d+ 1] 
and H C [d + 1] with r ^ H such that fjj and /jju{r} ars not in the same set. Without loss of 
generality we assume that r = d + 1. Now for 5 C [rf] and fixed value of td+i let a; — ► f' s td+i (x) 
denote the function fs(%) fsu{d+i}( x + td+i)- Using the shift invariance of the sets we have that 
E(/jj t l^d-i) = 0. Using lemma l24l for this system of functions we obtain that 

E X MM,-,U I] (/s, td+1 °^s) c(|S|) =0 
SC[d] 

for every fixed td+i- This completes the proof. 
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Lemma 2.16 Let f,g be L^A) functions such that f = fx + where f\ = ¥,(f\J-d-i) and 
g = gi + gi where g\ — E(g|JT d _ 1 ). Then 

J t \\f(x)W+i)\\u d =^||/i(x)^(^||^ + ||/ 2 (x)^T7)|| 2 ; d . (6) 

Proof. 

\\f(x)gJ^\\ 2 v d =E x , tl , t2 ,..., td+1 J] UWs) c(|s|) (7) 

se[d+i] 

Where fs = f whenever d + 1 £ S, fs = g whenever d + 1 G S and c(|5|) is the complex 
conjugation applied |5|-times. By substituting / = /i + f-i and g = g\ + 92 into (0 we get 2 2<i+1 
terms of the form 

E Xl4l , fa> ..., td+1 I] (/Ws) c(|S|) (8) 
se[d+i] 

where f' s is either /1 or fa if d + 1 ^ 5 and is ether g\ or 52 if d + 1 G 5. We call such a term 
"mixed" if both numbers 1 and 2 occur in the indices. 

Obviously it is enough to show that mixed terms are 0. Using the two shift invariant Hilbert 
spaces L2(Frf_i) and its orthogonal space the previous "mixed term lemma" finishes the proof. 

Corollary 2.5 Let f,g be L oa (A) functions such that non of¥,(f\J-d-i) and E^l^-i) is the 
function. Then the two variable function h(x, t) = ¥, x (f(x)g(x + t)\J-d-i) is not the function. 

Proof. The support of both fi = E(/|j r c ;_i) and <?i = K(g\!Fd-i) has positive measure. This 
means that for a positive measure set of i's the supports of /1 and 51(2; + 1) intersect each other in a 
positive measure set. Since Ud is a norm on L^Fd-i) we get that in © the right hand side is not 
0. By lemma l2~T"6l it means that for a positive measure set of t's \\f(x)g(x + t)\\u 4 f= 0. This means 
that h(x, t) is not the function. 

2.8 Gowers's norms in terms of character decomposition 

The main result of this chapter is an additivity theorem for the 2 fe -th power of the Uk norm. 

Theorem 6 (Additivity) Let (j) be an function with a decomposition 4> — cf>i + 02 + 03 + • • • 
converging in L^. Assume that E(0i(i£ + ^)<^>j (a;) l^fc— 2 ) = 0/or every pair i ^ j andt G A. Then 

iwi£=X>ii£ 

or equivalently 

00 

E(A tl)t2 ,..., tfc 0(z)) =X>( A tx,t 2 ,..,t*&(z)) 

i=l 

where t\,t%, . . . ,tf. and x are chosen uniformly at random. 



17 



Proof. First of all note that the series fa-\-fa + ... converges in L 2 . Since the L 2 norm is an upper 
bound on the Gowers norm it is enough to verify the statement for the case when this sum is finite. 
Let us assume that <j> = fa + fa + . . . + fa. We have that 

A tut2 _ tk fax)= H ^( X + J2U) C(ISI) = J2 Qf(x,ti,t2,...,t k ) 

5C[fc] i£S /:2M-»[n] 

where 

Q f (x,t 1 ,t 2 ,...,t k )= n fa- (s) (x+Y,u) c(isi} . 

SC[k] ies 

where c(r) is r-th power of the conjugation operation on C. If / is not a constant function then we 
say that Qf is a mixed term. We denote by Hi the set of functions {x — > fa(x + t)\t € A}. The 
mixed term lemma I2T51 applied to these sets shows that the integrals of mixed terms are all zero. 
This finishes the proof. 

Corollary 2.6 Let f be an function with k — l-order Fourier decomposition f = g + /1 + f% + 
/ 3 + . . . where f = fi + f 2 + ■ ■ ■ = E(/|^ fe -i). Then 

OO 

ii/ii£ = ii/'ii£ = Eii/^' 

i=l 

3 Higher order dual groups 

Let Afc denote the set of rank 1 modules over Loo^k-i, m)- The next lemma says that rank one 
modules are forming an abelian group. This fact is crucial for higher order Fourier analysis. 

Lemma 3.1 The set A^. is an Abelian group with respect to point wise multiplication on A. 

Proof. Let M\ and M% be two rank one modules over L 00 (J 7 / ! £ _i) and let fa S Mi, fa 6 M 2 be 
two fc-th order characters. The product <fi = fafa satisfies A t (f> — A t faA t fa 6 i 00 (JF fe _ 1 ) for 
every t 6 A and so it is contained in a rank one module M3. Any other functions fx € M\ and 
/a £ M 2 are of the form f\ = faXi, f 2 = fa\ 2 for some functions Ai, A2 G Loo^k-i)- This 
implies that fif 2 is in M 3 . Associativity and commutativity is clear. The inverse of Mi is generated 
by fa 

Definition 3.1 The abelian group structure on Afc is called the fc-th order dual group of A. 

The next theorem is the analogy of the fact from harmonic analysis that point wise multiplication 
of functions correspond to convolution in the dual language. 

Theorem 7 Let f,g be two functions in L^J-u). Assume for an arbitrary a 6 A& we denote the 
component of f and g in a by f a and g a . Then the component of f g in c £ Afc is equal to 

a-\-b—c 
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where the above sum has only countable many non zero term and the sum is convergent in L 2 . 

Proof. First of all we observe that if g is contained in one single rank one module then the fc-th 
order decomposition of fg is J2 a f a 9 smce it converges in L 2 and the terms f a g are from distinct 
rank one modules. From this observation we also get the statement if g has finitely many non zero 
components. 

If g has infinitely many components then for an arbitrary e we can approximate g e-close in L 2 
by a sub sum of its components g e . Then fg = fg e + f(g - g e ). Here the \\f(g - g e )\\ 2 < ||/||oo£- 
So as e goes to the L 2 error we make also goes to 0. 

3.1 Pure and locally pure characters 

The simplest example for a fc-th order character is a function : A — > C such that 

for every t\,t 2 , • ■ • , ife+i, x in A. Such functions will be called pure characters. Unfortunately for 
k > 1 there are groups A on which not every rank one module over Loc (J-fc-i) can be represented 
by a pure character. It will turn out however that every fc-th order character is (approximately) pure 
on "neighborhoods" measurable in Tk-i- ln other words fc-th order characters are (approximately) 
"locally pure" modulo some k — 1 degree decomposition of A. To make these statements precise 
we need new notation. 

Definition 3.2 Let B C A(A) be any a algebra. We say that a function <p ■ A — > C is a B-locally 
pure character of degree k if the function A tl;t2; ... ;tfe+1 0(a;) on A k+2 is measurable in the a algebra 
generatedby the a-algebras tp' s 1 (B) where S runs trough the subsets of {I, 2, . . . , fc+1}. We denote 
the set ofB locally pure characters of degree k by [B, k}*. 

In case B is the trivial a-algebra then [B, k]* is just the set fc-th order pure characters. 

Lemma 3.2 Let B C A(A) be a a-algebra. Then: 

1. [B, k]* is an Abelian group with respect to point wise multiplication. 

2. [B, 0]* is the set ofB measurable functions f : A — > C 

3. [B,k]* C [B,fc + 1]* 

4. IfB is invariant and 4> e [B, fc]* then A t (j) G B. k - 1]* for every t G A 
Definition 3.3 We introduce the B-local k-th order dual group [B, fc]° as the factor group 

[B,k]*/[B,k-l]*. 

One motivation for this notion is that it will turn out that Afe is naturally isomorphic to [Fk-i, k]°. 
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Lemma 3.3 Every element in [B, k]* is measurable in the a-algebra T k V B. 

Proof. Assume that / 6 [B, k]* . Let us consider the probability space A k+2 . Let C be the a- 
algebra generated by ipg 1 (A) where S runs through the non empty subsets of {1, 2, . . . , k+ 1}. Let 
9i = &ti,u,...,t k+ if{x) and 92 = f(x)/gi(x,t 1 ,t 2 , ■ ■ .,*fc+i). We have that g 1 is measurable in 
C V tp^ (B) and 52 is measurable in C. This means that / = g\gi is measurable in C V i/)7 (B). On 
the other hand / is measurable in ^^(A) and thus it is measurable in 

{CV^\B))h^\A). 

By definition tp^ 1 (A) is a coset a-algebra and so it is perpendicular to any shift invariant cr-algebras. 
Now we can use lemma I72~l"73l and lemma [2TT41 and obtain that / is measurable in 

(C A ^\A)) V %\B) = ^\F k ) V ^\B) = %\F k V B). 

Lemma 3.4 If <p is a k-th order character then <fi £ [!Fk-i, k]*. 

Proof. Let / denote the function At ll t 2 ,...,t k+1 4'( x ) on A fc+2 . It is clear that for every t £ A k+2 we 
have that A t f is measurable in the cr-algebra B generated by ^^{Tk-i) where S runs through the 
subsets of {1, 2, . . . , k + 1}. Using that B is shift invariant and lemma l2T2l we obtain that either / is 
measurable in B or E(f\B) — 0. However the second possibility is impossible since the integral of 
/ is equal to the k + 1-th Gowers norm of <fi which is positive because <f> € 

Corollary 3.1 If<j) is a k-th order character then there is an invariant a-algebra Tk-2 C B C T k -\ 
which is relative separable over T k -i such that /S. tl _t 2 4 l is measurable in Bfor every pair t\,t% G A. 

Proof. Lemma l3~4l implies that there is a separable a-algebra B\ C T k -\ such that 4> £ [Bi, k]*. 
Let B denote the smallest invariant a algebra containing Tk-2 and B\. Then <fi s [B, k}*. It is clear 
that B is relative separable over J-k-2 since it is generated by the shifts of countable many relative 
separable elements over J~k-2- Lemma [3721 implies that A fl t2 £ [B, k — 2]* for every t\ 1 to. G A. 
Using lemma [3731 we obtain that At 1( t 2 is measurable in B V Tk- 2 = B. 

3.2 A>types 

A fc-type T is defined as a countable subgroup of A&. It can be seen that fc-types are in a one to one 
correspondence with the shift invariant cr-algebras B that can be generated by countable many sets 
and Tu-\- Here B is the smallest cr-algebra in which all the elements from T are measurable. The 
group T is obtained from B as the rank 1 decomposition of L%(B, p) 

Definition 3.4 Let f be a measurable function in i 2 (^ r fc)- We say that the k-th dual-support S(f) C 
Afe of f is the set of rank one modules that are not orthogonal to f. It is clear that S(f) is a 



20 



countable set. The fc-typeT(/) of f is the group generated by the elements {g\g 2 1 I 5i7<?2 S S(f)}. 
If the value ofk is not clear from the context then we will use Tk(f) and Sk(f) instead ofT(f) and 
S(f). 

The next lemma follows from theorem|7] 
Lemma 3.5 Iff,g e then S(fg) C S(/)S(<?). 

Lemma 3.6 Let T be a fixed k-type and let TL denote the set of functions in L^Fk, whose types 
are contained in T. Then the set Ti. is closed under point-wise multiplication and under the shift 
operations. In particular A t TL C Jifor every t G A. 

Proof. Closeness under shift operations is trivial. Lemma [3~5l implies the statement on the the point 
wise multiplication. 

Proposition 3.1 Let (p be a k-th order character. Then there is a fixed k — 1 type T such that 
Tfc_i(A t </>) C T for every fixed t 6 A. 

Proof. Let B be the a-algebra guaranteed by corollary 13.11 and let T be the subgroup of Afe 
corresponding to B. We have that the dual support of A tl: t 2 ( t ) is contained in T for every t\,t2- Let 
t\ G Abe an arbitrary fixed element and let A tl (j> = A+/2 + - ■ • be the unique k — 1-th order Fourier 
decomposition of At x <f> into non zero functions. Assume that G Afc_i is the module containing 
fi for every i . We have to show that A, A J 1 G T for every pair of indices Let us choose a k — 1 -th 
order character fa from every module A, and let g^ denote (A tl <p)(j)i. We have that E(gj |JT fe _ 2 ) is not 
0. This means by lemma |231 that for a positive measure t%'s E(gi(x)gj(x + <2)|-? r fc-2) is not the 
function. On the other hand gi (x)g 3 (x + fa) = (At 1 ,t 2 (f>(x))fa(x)(pj(x+t2). Here fa(x)^)j(x+t2) 
is an element from the module AjA^ 1 . If E(gi(x)gj(x + ^2) l-^fc— 2) is not for some t% then the 
A^AJ 1 component of A tljt2 <j> is not zero. It shows that A^AJ 1 G T. 

Theorem 8 For every k-th order character <f> there is a countable subgroup T C A-k—i and a 
homomorphism h : A — > A^-i/T such that the k-th dual support of A t (f> is contained in the coset 
h{t). 

Proof. Proposition 13 . 1 1 implies that there is a countable subgroup T C Ak-i such that the dual 
support of A t 4> is contained in a coset of T for every element t G A. We denote this coset by h(t). 
We have to show that h is a homomorphism. This follows from the identity 

A tl+t2 <p(x) = A t2 cj>{x + h)A tl <j){x) 

using that the dual support of a function is shift invariant and theorem|7]the proof is complete. 
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Lemma 3.7 Let k > 2 and 4> be a k-th order character such that there is a countable subgroup 
T C A-k-i with the property that the k — 1-th dual support of At4> is contained in T for every 
t G A. Then (j) is measurable in Tk-\ (or in other words <j) represents the trivial module.) 

Proof. Let B be the er-algebra generated by the modules in T. Since T is countable we have that 
B is a separable extension of Tk-2- Now Lemma |2~3l implies that </> is contained in a shift invariant 
separable extension of B. which is also a shift invariant separable extension of J-k-i- 

3.3 Various Horn-sets 

We will need some notation. For two Abelian groups A\ and A 2 we denote by hom(Ai, A2) the 
set of all homomorphism from Ai to A 2 . The set hom(yl 1 , A 2 ) is an Abelian group with respect to 
the point wise multiplication. Let ^0(^2) denote the set of countable subgroups in A 2 . The groups 
hom(Ai, A 2 /T) where T 6 Ko(A2) are forming a direct system with the natural homomorphisms 
hom(Ai,A 2 /Ti) -> hom(Ai,A 2 /T 2 ) defined when T x C T 2 . 

Definition 3.5 hom*(Ai, A2) is the direct limit of the direct system 

{hom{Ai,A 2 /T)} TeMA2) 

with the homomorphisms induced by embeddings on ^0(^2). 

We describe the elements of horn* (Ai, A2). Let H(Ai,A2) be the disjoint union of all the 
sets hom(Ai, A2/T) where T is some countable subgroup of A2. If h\ £ hom(Ai, A2/T1) and 
h,2 G hom(Ai, ^42/^2) are two elements in H(A\, A 2 ) then we say that hi and h 2 are equivalent 
if there is a countable subgroup T3 of A2 containing both Ti and T2 such that hi composed with 
A2/T1 — > A2/T3 is the same as /12 composed with A2/T2 — > A2/T3. The equivalence classes in 
.ff(j4i, A2) are forming an Abelian group that we denote by hom*(Ai, A 2 ), 

For two abelian groups let hom c (Ai, A 2 ) denote the set of homomorphisms whose image is 
countable. We denote by hom°( J 4i, A 2 ) the factor hom(Ai, A2)/ hom c (Ai, A2). If T is a count- 
able subgroup of A2 then there is a natural embedding of hom°(Ai, A 2 /T) into hom*(Ai, A 2 ) 
in the following way. The set hom(Ai,A 2 /T) is a subset of H(Ai, A 2 ). It is easy to see that 
0i,02 G hom(Ai, A 2 /T) are equivalent if and only if they are contained in the same coset of 
hom c (Ai, A 2 ). From the definitions it follows that 

Lemma 3.8 

hom*(A 1 ,A 2 )= [J hom°(Ai,i4 2 /T). 
Corollary 3.2 /f Ai is of exponent n then so is hom*(A 1; A 2 ). 
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Note that an abelian group is said to be of exponent n if the rt-th power of every element is the 
identity. There is a simplification of the situation when A 2 is of exponent p for some prime number 
p. 

Lemma 3.9 If p is a prime number and A 2 is of exponent p then horn* {A\, A 2 ) = horn (A\, A^). 

Definition 3.6 We say that an Abelian group is essentially torsion free if there are at most countably 
many finite order elements in it. 

Lemma 3.10 If A is essentially torsion free then A/T is essentially torsion free whenever T G 
MA). 

Proof. Assume by contradiction that there are uncountably many finite order elements in A/T. 
Then there is a natural number n and element t G T such that the set S = {x \ x G A, x n = t} 
is uncountable. Then for a fixed element y G S the set Sy^ 1 is an uncountable set of finite order 
elements in A which is a contradiction. 

Lemma 3.11 If A2 is essentially torsion free then hom°(Ai, A2) is torsion free. 

Proof. Assume by contradiction that there is an element r 6 hom(Ai, A 2 ) and n G N such that 
t(Ai) is uncountable but r n (Ai) is countable. Similarly to the proof of lemma l3.10l this means that 
there is a fixed element t G T n (Ai) whose pre image under the map x — > x n is uncountable which 
is a contradiction. 

Lemma 3.12 If A 2 is essentially torsion free then hom*(Ai, A 2 ) is torsion free. 

Proof. By lemma [3~8l it is enough to prove that for every T G ^0(^2) the group hom°(Ai, A 2 /T) 
is torsion free. Lemma [3 . 1 01 implies that A 2 /T is essentially torsion free. Lemma [3.1 ll finishes the 
proof. 

3.4 On the structure of the higher order dual groups 

In this section we study the structure of higher order dual groups of A. Let us start with Ai. We 
know that Ai is the group of measurable homomorphisms A — » C. 

Lemma 3.13 The group Ai is isomorphic to A. 

Proof. We have that A is the ultra limit of a sequence { Ai}°l 1 of finite abelian groups. Let H C Ai 
denote the set of those characters that are ultra limit of characters on {Ai]°^ v Let Ai : Ai — > C and 
/!,: : Ai — > C be two sequences of linear characters. Let furthermore A be the ultra limit of {A,}^ 
and fi be the ultra limit of {p.i}°Z 1 . If Xi differs from fii on an index set which is in the ultra filter 
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then they are orthogonal at this index set and so they are orthogonal in the limit. This implies that 
A = fi if and only if the sequences {Xi}^Z 1 and {fii}°Z 1 agree on a set from the ultra filter. In other 
words H is isomorphic to the ultra product of the dual groups of {Ai}°^ 1 . Since the dual group of 
a finite abelian group A is isomorphic to A we obtain that H is isomorphic to A. 

To complete the proof we need to see that H — Ai . This follows from the well known fact that 
approximate characters on a finite Abelian group can be approximated with proper characters. 

By theorem [8] every fc-th order character induces a homomorphism from A to Ak-i/T for 
some countable subgroup. This homomorphism represents an element in hom*(A, A&_i). We 
denote this element by q(<p). If q{4>i) = q{4>2) then Lemma l3~7l shows that if k > 2 then <f>\ and fa 
belong to the same rank one module. This implies the following lemma. 

Lemma 3.14 Let k > 2 and fa and fa be two k-th order characters. Them q(fa) — q{fa) if 
and only if fa and fa generate the same rank one module over L oc (J r fc„i). It follows that q is an 
injective homomorphism of A& into horn* (A, Afc_i) 

Of course if k — 1 then q is not injective however the situation is even better. In this case Ai is 
embedded into hom(A, C) = hom(A, Ao). Lemma [3.14| has a few interesting consequences. 

Lemma 3.15 Let p be a prime number and assume that A has exponent p. Then for every k > 1 
the group A^ has exponent p. 

Proof. We go by induction. We know that Ai is isomorphic with A so it has exponent p. Assume 
that it is true for k then Corollary 13. 2| and Lemma [3.14| ensure that it remains true for k + 1. 
The next lemma follows immediately from Lemma [3. 141 

Lemma 3.16 A& is embedded into both 

horn* (A, horn* (A, . . . , horn* (A, Ai)) . . .) 

and 

horn* (A, horn* (A, . . . . horn* (A, hom(A, Cjj) . . .) 
where the number of 'horn* -s is k — 1, 

Proof. The proof follows directly from Lemma [3.14l and the fact that horn* (Ai , A%) C horn* ( A\ , ^3 ) 
whenever A2 C A3. 

It interesting to note that 

fc 

hom(A, hom(A, . . . , hom(A, C)) . . .) ~ horn ((g) A, C\ 

i=i 

which shows some connection of higher order Fourier analysis with higher order polynomials. How- 
ever the situation is more complex due to the presence of the *'s at the hom functions. 
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3.5 Maps induced by measurable homomorphisms of A 

Let <Ji : Aj — > Ai be a sequence of automorphisms. We denote by a the ultra product of {0^}°^ 
which is an automorphism of A. Automorphisms that arise this way will be called measurable 
automorphisms. Similarly we can define measurable endomorphisms. 

In the following lemmas a will always denote a measurable automorphism on A. 

Lemma 3.17 Let f be an function measurable in J~k- Then f a {x) = f(a(x)) is also measur- 
able in Tk- 

Proof. Lemma [2. 101 implies that the Gowers norm Uk+i is preserved under a. Since the scalar 
product is also preserved under er, by Lemma fTTI the proof is complete. 

Lemma 3.18 Letk > 1-be a natural number. Then a permutes the rank one modules over L^J-k-i- 
This action induces an automorphism o/Afe. By abusing the notation this action will also be denoted 
by a. 

Note that if r is an arbitrary automorphism of an abelian group A2 then it induces an action on 

hom*(Ai,^4 2 )- 

Lemma 3.19 The embedding q : A& — > horn* (A, A^-i) commutes with the action a 

Lemma 3.20 Let n be an integer co-prime to all the numbers \Ai\,i — 1,2,.... Then a : x — > x n 
is a measurable automorphism on A and the induced action on A& is again given by x — > x n for 
every k > 1. 

Proof. The statement is clear for k = 1. Then Lemma [3.19| and induction on k finishes the proof. 

We believe that the next corollary should have a simple proof but with the current path of argu- 
ments we use the full theory developed here. 

Corollary 3.3 (reflected character) Assume that <p is a k-th order character then x — > 4>{x)4>(— x) 
is measurable in J-k-i- 

3.6 Examples 

Prime characteristic: 

We have seen that if A is of exponent p (which is equivalent with saying that it is an ultra product 
of elementary abelian groups of exponent p) then all the higher order dual groups Afe have exponent 
p. In other words, up to abstract isomorphism, we have a full understanding of their structure. 

Is this section we look at other interesting examples. 

The finite rank case: 
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Assume that in the sequence {Ai}°^ 1 each term is of rank at most r. This means that they can 
be generated by at most r elements. Since in this case Ai contains at most n r elements of order n 
for every fixed n it follows that A has the same property and so Ai = A is essentially torsion free. 
Now lemma ITT21 and lemma [3T4l imply that Afc has to be torsion free for every k > 2. 

High characteristic case: 

The situation of the finite rank case can be generalized. Assume that for every n the number of 
elements of order n is at most f(n). Then again A is essentially torsion free and bAk is torsion free 
whenever fc > 2. 

An interesting phenomenon is that in the high characteristic case the divisible group Q can be 
embedded into A and so into Ai showing that Ai is not isomorphic to the free abelian group with 
uncountable many generators. 

4 The multi linear cr-algebra 

In this section we introduce the "multi linear" er-algebra on the fc-fold direct product A fc . We prove 
a correspondence between the fc-th order characters in this er-algebra and the fc-th order characters 
of A. The main motivation is the following simple observation. Let <fi be a fc-th order pure character 
on A. We have that At 1; t 2 ,... : t k+1 4> is the constant 1 function. This implies At l t2 ... it( .</)is a constant 
function the value of which is the exponential of a fc-linear form on A. Furthermore it is easy to see 
that this fc-linear form uniquely characterizes the rank one module containing ip. An advantage can 
be seen immediately. Let us assume that A is of characteristic p. Then there are pure characters that 
take values which are not necessarily p-th root of unities. However the corresponding bilinear forms 
take only p-th roots of unities. 

It will turn out in this section that this phenomenon generalizes to non pure characters. In the 
general case A tl . t2 ,...,t k <fc(x) wont always be a constant function but its integral according to x is 
not and is measurable in a cr-algebra which can be called "multi linear" cr-algebra. Characters of 
this cr-algebras are similar to multi linear functions. 

4.1 definitions and basics 

Definition 4.1 Let A and B be two ultra product groups. Let B\ C .4(A) and B2 C 4(B) be two 
a-algebras. Then their strong product B\ * B2 consists of all measurable sets S in A(A x B) such 
that ({x} xB)flS is in Bifor every x £ A and (A x {y}) H S is in B\for every fixed y in B. 

The operation * is clearly associative. Let Xi, X2, . . . , X„ be a collection of ultra product sets 
and let X denote their direct product. For every subset S C [n] we define the cylindric sigma 
algebra cts(X) as the pre image of the ultra product cr-algebra of Yl ieS Xi under the projection 
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X — > riies -^»* Cylindric er-algebras were first introduced in [ 1 1 to study hypergraph regularity and 
hypargraph limits. The arithmetic of these a-algebras is completely described in (TJ. It is easy to 
see that cylindric a algebras behave nicely under strong product in the following sense. 

Lemma 4.1 Let m < n be a natural number, Let Yi = Yii=i an d "^2 = II"=m+i ^-i- G\ 
be a collection of subsets o/{l, 2, . . . , m} and G2 be a collection of subsets of{m+l, m+2, . . . , n}. 
Then 

( \/ *sCYi)) * ( V ^(Y 2 )) = \/ 

sed 5sg 2 s l eG l ,s 2 eG- 2 

The strong product of Fourier u-algebras is of special interest. For a vector v = i>2, ■ ■ ■ , Vk) 
of length k with Uj G N we can introduce the generalized Fourier cr-algebra T v on A k by 

j. v F Vl ~k F y 2 ~k . . . ~k j * Vk . 

If v = (1, 1, . . . , 1) of length k then we call T v on A fc the fc-linear cr-algebra. We will also denote 
the fc-linear cr-algebra by -k k T\. 

Lemma 4.2 The k-linear a-algebra * k T\ is contained in .F fc (A fe ). 

Proof. Let us introduce k(k + 1) copies of A. In order to distinguish them we denote them by Ajj 
with 1 < i < k and 1 < j < k + 1. Let Bj = ]X=i -Ajj. To P rove the lemma we need to show that 
if a function / is measurable in the fc-linear a algebra then f{x\ + X2 + ■ ■ ■ + %k+l) with x i € Bj 
is measurable in 

\f crs(Bi x B 2 x ... x B fe+ i). 

SC[fe+l],|S|=fe 

For every 1 < t < k and 1 < s < k + 1 let Q t}S C [fc] x [k + 1] denote the set 

Qt.s ■= 7^ * or (i = t and j = s)}. 

Lemma l4~Tl implies that f(xi + x-i + . . . + Xk+i) is measurable in each of 

B t := \/ ^,(A fe ( fc+1 )). 
je[*+i] 

The intersection of the cr-algebras Bi is equal to 

V CTS/ (A fe ( fe+1 >) 

f:[k]->[k+l] 

where Sf denotes the graph of the function /. This completes the proof. 



27 



4.2 The multi-linear representation map 

Motivated by the definition of the Gowers uniformity norm we introduce the functional Vfc : Loo(A) - 
L ocs (A k ) defined by 

V k (f)(ti,t 2 ,...,t k ) = [ A tl , i2 ,... A /(4 

We call Vfe(/) the fc-linear representation of /. The fc-linear representation has two surprising 
properties summarized in lemma |4~3l and lemma |4~6l 

Lemma 4.3 If f is any function on A then Vk{f) is measurable in the k-linear a algebra 
* fe ^i(A). 

This lemma follows immediately from the next lemma. 
Lemma 4.4 Let f and g be two functions on A. then h(t) = J f(x)g(x + t) is measurable in 

Proof. Let m(x, y) = f{x)g(y). Let m' be the projection of m to the coset a-algebra on A x A 
corresponding to the subgroup {(a, b)\a + 6 = 0}. Since m is measurable in the shift invariant 
cr-algebra cr^ V cr{ 2 } (A 2 ) then so is m'. On the other hand m'(x, y) — h(x — y). This means that 
h must be in T\ . 

Corollary 4.1 (Convolution is linear) The convolution of two functions on A is measurable 
in the linear a-algebra J-\. 

Lemma 4.5 Let f 6 Lq^A) be a function with \\f\\u k +i > 0- Then for a positive measure oft's 
l|At/|k > 0. 

Proof. The condition of the lemma shows that the fc-th order Fourier expansion of K(f\Tk) contains 
a nonzero term corresponding to a module A £ Afc. Let be a fc-th order character from the 
module A. Then E(/(/>| Tk-i) in not 0. This means by lemma |231 that for a positive measure of t's 
E(A t (/^)| T k -i) is not 0. On the other hand 

E(A t (/^)|^_i) = E(At/|^_i)A t 

This means that E(A 4 /| Tk-i) is not for a positive measure of fs which completes the proof. 

Lemma 4.6 Let f G L^A) be a function with \\f\\u k +i > 0- Then Vk(f) is not the zero function. 

Proof. By iterating the previous lemma we obtain that for a positive measure of fc-tuples t\ , ■ ■ ■ , tfc 
the value of ||At 1> t 2) ...,t i ./||!7 1 is bigger then 0. This means that for these fc-tuples V(f) can't be 0. 

Let G denote the fc-th dual group of A k . Without proof we mention that elements in G that can 
be represented by functions measurable in the multi linear cr-algebra are forming a subgroup of G 2 
of G. The fc-liner representation map induces an embedding of A k into G 2 - 
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5 Finite statements 



In this part of the paper we demonstrate how to translate statements of higher order Fourier theory 
into finite ones. Unfortunately we loose the precise algebraic nature of many statements and instead 
we get approximative ones. In general, there is an almost "algorithmic way" of translating infinite 
results from ultra product spaces to finite statements. However in some special situations one has to 
be careful. An important goal of this part is to prove regularity type results for bounded functions on 
abelian groups. For every natural number fc we provide a fc-th order regularization which is a finite 
version of the fc-th order Fourier decomposition. 

Regularity type results in combinatorics usually come in various strength. We have to note 
that both weak and strong versions have their own advantages. Many regularity lemmas fall into a 
category that we call "plain regularity". The general scheme for (strong versions of) plain regularity 
lemmas is the following. 

Rough scheme for plain regularity: Let us fix an arbitrary function F : N — > M+. Let f be a 

bounded (say ||/||oo < 1J function on some finite structure. Let us choose a number e > 0. Then, 
if the structure is "big enough" then f can be decomposed into three parts f = f s + f e + f r . The 
function f s is the structured part and has "complexity" at most n where n is bounded in terms of e 
and F. It is usually assumed that f s is bounded. The function f e is an error term with \\f e \\2 < £• 
The function f r is "quasi random" with precision F(n). 

An example for plain regularity is the graph regularity lemma by Szemeredi. An example of a 
regularity lemma which doesn' t fit into this framework is the so called hypergraph regularity lemma. 
Our regularity lemmas for functions on Abelian groups will also be more complicated because fc-th 
order fourier analysis is closely related to the regularization of fc-uniform hypergraphs. In this part 
of the paper we prove various regularity lemmas for functions. As a demonstration we highlight one 
of them. 

Definition 5.1 Let P = {Pi,P 2 , ■ ■ ■ ,P n } be a partition of an abelian group A. We say that a 
function f : A — > C is a k-th degree (P, e)-character if 

A tu t 2 ,...,t k+1 f(x) = g(h,t 2 ,.. .,t k+1 ,x)+r(h,t 2 , . . .,t k +i,x) 

where \\r\\2 < e and the value of g depends only on the partition sets containing the sums J2ieS 
where S C [k + 1]. 

Definition 5.2 (Complexity-I.) Let A be an abelian group. We define the complexity notion c\ (fc, n, e) 
with parameters n — (ni, n 2l . . . , n^k) G N 2k and e = (ei, e 2 , ■ ■ ■ , £2fc) € K. +2fe . 

We say that a function f : A — > C , ||/||oo < 1 has complexity Ci(fc, n, e) if it has a decomposi- 
tion f = h + fi + f 2 + ■ ■ ■ + fm with m < n 2k , ||/i||oo < 1 , \\h\\2 < ^2k and A-has a partition 
P = {P 1 ,P 2 , . . . , P 2k -i} such that 
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1. each function fi is a k-th order (P, e 2 k-i)-character 

2. for each partition set Pi the function 1 p i has complexity 

ci(k - 1, (n 2 fc-2,«2fc-3, • • • ,ni), (e 2fc _ 2 ,e 2fe _ 3 , • ■ -,ei))- 

/n the case k = we say that only constant functions are of complexity (0, n, e) no matter what n 
and e is. 

Theorem 9 (fc-th order Fourier-regularity-I.) For every system of functions Fi : W — > M+ (i = 

0, 1, 2, . . . , 2k — 1) andG : N 2fe — > M+ f/;ere is a natural number s such that every function f : A — > 
C , ll/Hoc < I on an abelian group A of size at least s there are natural numbers m, n 2 , . . . , n 2 fe 
between 1 anc/ s one/ a decomposition f = f + g where \\g\\u k+1 < G{n\, n 2 , . . . , n 2 fc) a«<i /' is 
of complexity 

ci (fc, (ni, n 2 , . . . , n 2 fc), (P 2 fc-i("2, "3, • • ■ , «2fc), F 2 k~i(n? n n 4 , . . . , n 2fc ), . . . , F )) • 

5.1 Function properties 

A property in general is just a subset of objects under investigation. In this chapter we will talk 
about function properties on abelian groups. A finite function property is a property defined on the 
set of all complex valued functions on finite abelian groups. An infinite function property is defined 
on the set of measurable functions on groups that are ultra products of finite abelian groups. 

Definition 5.3 Let V be a finite function property. We define the infinite function property 

d(V) - {/|/ - lim/i , fi-.Ai^C, fiGV , sup H/^U < ^} 

w i 

where oj is an arbitrary ultra filter and {Ai}°°^ 1 is an arbitrary sequence of finite abelian groups 
with an infinite ultra product. 

Definition 5.4 Let V(n,e) be a parameterized family of function properties with parameters n — 
(ni,n 2 , . . . , n r ) s N r and e = (e 1; e 2 , . . . , e r ) G M +r . Wfe say f/iaf V(n,e) characterizes a certain 
infinite function property V if 

^'=nun u • nix^)) 

5.2 Fourier regularity 

Definition 5.5 Let T' k denote the infinite function property that f is measurable in and ||/||oo < 
1. 
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Theorem 10 (general form of k-th order Fourier-regularity) LetV((n 1 ,n 2 , n r ), (ex, £2, , 
be a 2r parameter family of function properties which characterizes a property containing J-' k . Then 
for every system of functions Fi : W — > R + (i = 0, 1, 2, . . . , r — 1) and G : W — > R + there is a 
natural number s such that for every function f : A — > C , fx' 1 "" <m abelian group A of size 
at least s there there are numbers Tlx, n 2 , ■ ■ ■ , n r between 1 and s and a decomposition / = /' + .9 
where \\g\\u k+ i < G(p>\, n 2 , ■ ■ ■ , n r ) and f has property 

v((nx,ri2, n r ), (F r -x(ri2,n 3 , . . . ,n r ), F r _ 2 (n 3 , n 4 , . . . , n r ), . . . , F )^ (9) 

Proof. We go by contradiction. Assume that for a fixed set of functions there is a sequence of 
counterexamples fi : Ai — > C for the statement with s = i. In particular this means that \A{\ > i 
and so their ultra product A is infinite. Let / : A — » C denote the ultra limit of {/i}^. We have 
that f = f + g where /' = E(/|J : a.) and ||<7||i7 fc+1 = 0. The fact that V characterizes a property 
containing Tu implies that there is a sequence (m, n 2 , ■ ■ ■ , nt) such that /' is contained in 

cl(v((nx,n2, ■■■,n r ), (F r _i(n 2 , n 3 , . . . , n r ), F r ^ 2 (n 3 , n 4 , ...,n r ),.. . ,F )jj. 

and so there is a sequence {/j}^! with ultra limit /' such that /' has property (0. Let gi = fi — f[. 
The ultra limit of {gi}"^x i s .9 ar, d so me ultra limit of ||<7i||[4+i is 0. This means that there is a natural 
numbers > max(ni, n 2 , . . . , n r ) with ||p a ||t/ fc+1 < G(ni,n 2 , . . . ,n r ). This is a contradiction since 
the decomposition f s = f' s + g s satisfies the statement. 

Lemma 5.1 The property characterized by the complexity notion c\ (k, n, e) contains T' k . 

Proof. We go by induction on k. First we show that if / g T' then \/e 2 k 3n 2 k Me 2 k-x~^n 2 k-i such 
that / has a decomposition / = h + fx + f 2 + . . . + f m with m < n 2k , \\fi\\oo < 1 , W^h < <^2k 
and A-has a partition P = {Pi ,P 2 ,..., P 2 k-x } such that 

1. each function fi is a k-th order (P. e2/c-i)-character 

2. each partition set Pi is measurable in J-k-x 

To see this we consider the fc-th order Fourier decomposition / = fi+f 2 +. . .. Since fi+f 2 +. . . 
converges in L 2 there is a natural number n 2 k such that \\f — fx — fs ■ . • — fn 2k II 2 < e 2k- Lemma 
13.41 implies that there is a separable er-algebra B C Th-x such that f e [B, k]* for every i. This 
means that there is a finite sub cr-algebra B 2 C B such that the projections rj of the functions 
hi = A-t lt t 2 ,...,t h+1 fi(%) on A k+2 to the a algebra generated by the u-algebras ipg 1 (B2) where S 
runs trough the subsets of {1, 2, . . . , k + 1} satisfy \\ri — hi\\ < £2fc-i whenever i = 1,2,..., rt2fc- 
It follows that the atoms of £>i are forming a partition P such that /j is an (P, e 2 fc_i)-character 
whenever i < n 2 k- 
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Now by our induction step and by using that there are only finitely many partition sets in P we 
obtain the formula that Ve2fc 3n 2 k Ve2fc-i3ri2fc-i . . . Vei 3n\ such that every partition set in P is in 
the closure of ci(fc - 1, (n 2 k-2, n 2k -3, ■ ■ ■ ,ni), (e 2 fc-2, £2fc-3, ■ ■ • ,ei)). 

By considering a finite approximation of the system {fi}™ =1 and finite approximations of the 
partition sets with property cx(k-l, (n 2k ^ 2 ,n 2k ^ 3 , ■ ■ ■ (e2k-2> £2fc-3, ■ ■ ., £i)) we obtain that 
the property characterized by ci contains J 7 ^. 

5.3 Finite algorithm for the &>th order Fourier decomposition (sketch) 

We start with some motivation that comes from ordinary Fourier analysis. Let / : A i— > C be a 
function on a finite abelian group and let 

/ = £>iAi (10) 

i=l 

be its ordinary Fourier decomposition where the terms \i are linear characters and their coeffi- 
cients are ordered in a way that |Ai| > | A2 1 > | A3 1 > .... Let Mf be the A x A rank one matrix 
//*. For all matrix operations we use the normalization introduced in chapter|4] 

The group A is acting on the entries of Mf in the natural way: (x, y) a = (x + a,y + a). Let Mj 
be the matrix obtained from Mf by averaging out the action of A. This is: Mf = l/\A\ J2aeA Mf. 
It is easy to see that 

\A\ 

M f = J2xiX*\h\ 2 - 

i=l 

In other words the eigenvectors of Mf (if they have multiplicity one !) are constant multiples of 
linear characters on A. The importance of this observation is that to define Mf we don't need the 
concepts of Fourier decomposition and characters but its eigenvectors (corresponding to multiplicity 
one eigenvalues) are linear characters. 

It is natural to ask if we can obtain quadratic decomposition of / in a similar way? The averaging 
used to obtain Mf corresponds to a projection to the trivial cr-algebra Tq. It turns out from theorem 
[3] that to get a quadratic decomposition we need to use projections to T\. The problem is that such 
a projection does not have a precise finite analogy but fortunately we are able to "approximate it". 

For every e > we define the (non linear) operator P e : A* — > A* such that 

Pe(f) - E 

|A<|>6 

provided that / has decomposition ( TTOb . These operators obviously commute with the shift operators 
defined by S a (f)(x) = f(x + a) where a S A. Now we define Q e j(x,y) to be 

P e (a -> M f (x + a, y + a))(0). 
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We consider Q e j as a finite analogy of the operator K,%{f). 

Very roughly speaking, if we fix a natural number m and a small constant e > then if A is 
big enough then (appropriate constant multiples of the) eigenvectors corresponding to the m largest 
eigenvalues of Q e ./ can be regarded as "finite approximations" of the quadratic decomposition of /. 

There are however problems with this statement that can be fixed with careful work. The biggest 
problem already appears in the infinite language. In corollary 12. 2| we see that if K-k(f) has multiple 
eigenvalues that it require further work to read off the fc-th order decomposition of /. Unfortunately, 
in the finite analogy multiple eigenvalues correspond to close eigenvalues, so the above algorithm 
only works if the m largest eigenvalues are "well separated". If not, then we need a refinement of 
the algorithm. 

We also need to understand in what sense Q e t is a finite version of faif). Let : Ai — > C be 
a sequence of bounded functions. We denote by M f the ultra limit of the matrices Q e j- It is easy to 
see that as e goes to the matrix M e converges to X^/) m L 2 - This will imply that the m largest 
eigenvalues also converge in L 2 - On the other hand theorem[4]tells us how the eigenvectors behave 
when the ultra limits of operators is taken. 

The full algorithm will be discussed in a separate paper. 

Balazs Szegedy University of Toronto, Department of Mathematics, St George St. 40, Toronto, ON, 
M5R 2E4, Canada 
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